Reliability analysis in therapeutic research: practice and procedures.

نویسندگان

  • K J Ottenbacher
  • S D Tomchek
چکیده

Twenty studies examining the reliability of assessment devices and outcome measures in therapeutic research were reviewed and analyzed. The 20 investigations contained 215 quantitative reliability values published in either the American Journal of Occupational Therapy or Physical Therapy during the past 5 years. The reliability studies were classified as interrater, intrarater, test-retest, or internal consistency. Examination of interrater reliability accounted for 41% of all reported reliability values. Studies published in Physical Therapy were more likely to be concerned with test-retest reliability, whereas studies published in the American Journal of Occupational Therapy more often focused on interrater reliability. Examination of the data revealed that the intraclass correlation coefficient (ICC) was the most frequently reported estimate of reliability, accounting for 57% of all reported reliability coefficients. Further review of the results indicated that Pearson product-moment correlations and percentage of agreement indexes accounted for 22% of all reliability values reported in the studies examined. The Pearson product-moment correlation measures association or covariation among variables, but not agreement, and percentage agreement indexes do not correct for chance agreement. The argument is made that product-moment correlations and percentage agreement indexes are inadequate measures of interrater, intrarater or test-retest agreement. They should be used and interpreted with caution.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Evaluation of Maximum Patient Skin Dose Arising from Interventional Cardiology Using Thermoluminescence Dosimeter in Mashhad, Iran

Introduction The increasing practice of interventional fluoroscopy in diagnosis and treatment of cardiovascular disease has risen attention to improve radiation protection of patients and cardiologists in these relatively high dose techniques. Therefore, nowadays there is an emphasis on the measurement of radiation dose received by patients and cardiologists arising from the relevant procedures...

متن کامل

Assessment of change in dynamic psychotherapy.

Five scales have been developed to assess changes that are consistent with the therapeutic rationales and procedures of dynamic psychotherapy. Seven raters evaluated 50 patients before and 36 patients again after brief dynamic psychotherapy. A factor analysis indicated that the scales represent a dimension that is discriminable from general symptoms. A summary measure, Dynamic Capacity, was rat...

متن کامل

Reliability and Validity of Dental Measurements Made on Digital and Stone Orthodontic Models

Introduction: A study model is a precise three dimensional replica of patient’s dentition and plays an important role in treatment planning. Many digital multi-media applications have become available to the clinician and his or her staff to facilitate standard procedures in practice and management. The aim of this study is to evaluate reliability and validity of dental measurement made on dig...

متن کامل

Effect of Triage Education on knowledge, attitude and practice of nurses in Poursina Educational and Therapeutic Emergency center in Rasht

Introduction: One of the most important functions of nurses is preserving lives of clients in emergency cases, thus it is necessary that nurses be aware of triage procedure, so that upon which they can provide quick and correct nursing interventions to those injured by on time identification of needs in critical conditions. Objective: This study aims to determine the effect of triage educati...

متن کامل

Investigating the Reliability and Validity of the Cognitive Flexibility Inventory (CFI-I) among Iranian University Students

Objective: The purpose of the present study was to inspect the validity and reliability of the Iranian version of the Cognitive Flexibility Inventory (CFI-I). Methods: The statistical population of the present study was selected among the university students studying at Shiraz University in the 2010-2011 academic year. Two hundred and seventy seven of the university students were recruited v...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • The American journal of occupational therapy : official publication of the American Occupational Therapy Association

دوره 47 1  شماره 

صفحات  -

تاریخ انتشار 1993